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ABSTRACT 

A theoretical framework that distingi" shes the 
knowledge, or competence, aspect of language proficiency from the 
skills aspect is outlined, and the factors in the language testing 
situation that affect performance on language tests are examined. The 
model is intended for use in assessing the construct validity of 
tests of language proficiency and in clarifying some terms and 
concepts that have been used to describe various aspects of language 
proficiency. The nature of the performance tasks and language 
competencies required by some widely used testing procedures are then 
examined within this framework, and the implications for psychometric 
theory and language testing research are discussed. (MSE) 
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AN EXAMINATION OF SOME LANGUAGE PROFICIENCY TESTS FROfl A COMMUNICATIVE 
VIEWPOINT 

Lyle F. Bachman (University of Illinois at Urbana -Champaign) 



1 Intrjduction 

The theme of this conference* tanquege « Knowledge end Skill," 
is particularly well-chosen, since it represents* I believe* e 
recognition that language proficiency Involves both knowledge* or 
competence* and skill in implementing* or executing that competence. 
Skills and components models such as those proposed by Lado (1961) end 
Carroll (1961) distinguished skills (listening* speaking* reading* and 
writing) from components of knowledge (gremmer* vocabulary* 
phonology/graphology)* but did not indicate how these were releted. 
It was not clear whether the skills were simply manifestations of the 
knowledge components in different modalities end channels, or whether 
they were qualitatively different in some other ways. For example* 
does reading differ from writing only In thet it involves reception 
rather then production? If thet were so* how can we account for the 
feet that quite competent and skillful readers ere not always skillful 
writars? Chomsky's modal (1965)* with Its distinction between compe- 
tence and performance* permitted us to distinguish random "noise* from 
language proficiency* but in so doing limited language proficiency 
solely to competence. And neither of these models recognized the full 
context of language use— th^ contexts of discourse and situation. 
Halliday's framework (1976)* with its focus on functions* both illocu- 
tionary and textual* cleerly recognizes the context of discourse* hut 
again is limited to competence. Finally* although Hymes 1 (1972) 
notion of sociollngulstic appropriateness recognizee the interaction 
between language use and the context of situation, it does not address 
the distinction between competence and skill. 

Recent frameworks of communicative competence (flunby* 1976| 
U'iddowson* 19781 Cenale A Swain* 19801 Sevlgnon* 1983)* provide e 
much more inclusive description of the the knowledge required to use 
language* U* that they incorporate linguistic competence* discourse 
competence* end sociollngulstic competence. All of these frameworke 
comprise what might be called descriptive rather then working Models 
in thet they focus on competence and either explicitly or implicitly 
ignore the Implementation of that competence in language uaa. A more 
cognitive approach to language use has been taken in working models of 
language processing such as those proposed by Faerch and Keeper (1963) 
and Sielystok end Ryan (forthcoming). But while such modele 
distinguish planning from execution end characterize varying degrees 
of cognitive control in language processing* they do not opacify how 
language competencies era distinguished from language skills. 

At this point it may be useful to discuss whet evidence there le 
for e distinction between competence end skill. Ths first kind of 
.evidence lies in ths dlffsrsntisl Implementation of competence in 
different, skill mcdes. It is wall-known, for example, thet 
comprehension gsnsrslly precades production* both in first and in 
second language acquisition, tf ths rsquisits coapstsnciss srs 
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present for coupiohsnsion, what csusss this iaplsmsntstion in 
prouucuton to lag behind? Llkswlss with differences in chennel. 
Fluent reeding does not necessarily Imply fluent listening, or vice- 
verse. Another kind of evidence can be found in the literature on 
coaaunicetion strategies, which deals with the ways in which 
Individuals etteapt to achieve soae coaaunicetion poel in a given 
language despite Inadequate coaaunicetive coapetence in that language. 
In such cases the individual aay be able to coapenaata for inadequate 
coapetence by the lapleeentetlon of various etr.tegiee. Thus, the 
aoet skillful coaaunlcetor aay not necaasarlly be the individual w'th 
the greatest coapetanoa. 

To aeeure you that I aa not aerely Juggling tsras, I win 
e theoretical freaawork that dletingulshes the knowleo\ 
coapetence aspect e ef language proficiency froa the skills ea> 

and that eieo id df the factors In the language testing situ- 

that affect pa s foiasn u e on language teats. I believe this aodsl in 
of use In exealnlng the construct validity of tests of lenguoge 
proficiency and in clarifying soae terse end concepts that have been 
used to describe various aspects of language proficiency. I will then 
exeaina, within thie freeawork, the nature of the psrforaance teska 
and language coapetanciee raouirad by soae widely used tasting 
procedure.. Finally, I will discuss the lapllcetlone that thie 
ojualnatlo* euejotte for psyohooetrio theory and for language tasting 



2 A freaeworkfpr deecrlblng perforaence on tests of lsnguega 
proficiency 

Adrian Peleer end I have proposed e f roaework for dsscribing the 
different factors that effect porfoceenta on language teete (Bechaan 
end Peleer, forthcoaing). Thie freaework includes four types of 
factors! language trait factors, skill factore, aathod factors, and 
rsndoa factors. IjfHriTaT trait foctoro ere those coapetenciea or 
aentei sol litis* that ere specific to language uss, and era of two 
aeln type. i organ 1 re tlonel coapetence and pragaatlc coapetence. 
OrganixaUoaal oeapetence, which Includes graaaatlcal and discourse 
coapetence, pertains to ths foraal character ietics of language uaags. 
PTsoaatii. rswaiilaiiiii which Includes lllocutionary and sociollngulstlc 
competence, onrtalne to the functional and social characteristics of 
longusps uaa, 

JhUL UsiSSl thoee general chsractariatice of the individual 
that affect teat porforaanca. These consist of 1) psycho- 
physiological skills, which are distinguished in terae of node 
(proteUwsVreeaaUva) end ohsnasl (aurel-oral/vleual), 2) forae of 
representation (usnacioue /subconscious, enal y 2 ed/unanaly zed, pre- 
fabric. tad routines, rulee), which dotereine the extent to which 
lenguege coapetenclce are evellable for use, and 3) etretegic 
coevetanca. which consists of s set of genr-U abilltlss that effect 
how language ouapstencies are lapl e aanted for eexleue effectXveneee in 
processing Woraatlen. 
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Wsthod factor* ere those characteristics of the test aethod that 
•f fact performance. Those factors conaiat of 1) the typo of langusgs 
uaa oltuatlon ( reciprocal/ nonreciprocal), 2) tha eeount of context 
(sabe<k*d/rsducsd) 5 3) tha distribution of information (compact/ 
diffusa)* 4) tha typo of information presented (concrete/ebs tract), 
and 5) tha typo and daQraa of restrictions on languavga performencei 
thasa Includa rastrlctiona on tha organization of discourse, tha 
longuegs uaa eltuotlon, propoaltlonal content, illocutionary force, 
foraa. participants, moos, channel and time/length. Tommunlcotlve* 
tasting aathods alght ba charactarlzad as those involving, relatively 
unrestricted, sppropriataly contsxtusllxsd language psrformsnce. anils 
"non- ucaunlcctlve* testing eettode Involve only artificially 
restricted, Inappropriately contextusllrsd " 



Finally i pnpjps i factors consist of 1 ) cognitive and ef f active 
cherecterlstlcs of the Individual, ouch ae field ompentfencc/ 
Independence, inhibition, tolaranca/intolaranca of smoiguity, aid 
activation. 2) Interactions aaong specif ic coaainatlona of trait, 
skill ort Method factors* and 3) 



One application of this framework has boon In tha oaf Initio? jf 
tsras that haws been ussd to refer to various aspects of las' go 
prof icisncy (Sechmen and Palmer, lias). MTylftk competence _ be 
defined as consisting of ths trait M ^ -TT^^vl^TnmnWwi 



•yntex. aorphology. and phonolao^/gfapneio^y, ille c^s s ^gitlv| 



competence consists of linguistic coapetance clue tha . 

discourse competence, illocutionary coapatsnca, and soclallnfutsUj: 



language s kills (listening, speaking* reading, writing) conaiat 
of trslt *id skill factori. Linguistic oa i for m ania consiats of tha 
nsnifsfc ation of linguistic cottpetenee and skill f setose in 
artificially restricted and inappropriately contextual ireeV taet 
sltustlons (aathods). Communicative performance consists af tha 
aonlfsatstlon of communicative cocxWtoncc and skill factors in 
rtletlvsly unrsstrlctsd and appropriately contcxtuelized taat 
sltustlons (aathods). 

A aeaeure of llnoylstlc corf ormmnco Includes that portion af a 
test scora attributable to linguistic competenes. skill feasors, 
artif lelally restricted and Inappropriately contsjctusliisd Method 
factors, and rsnooa factors* A i 
includss that portion of a taat" 



competence, aklll factors, relatively unrestricted end appropriately 
contextuslitsd aathod factors, end randoa factora. *.£ - ilfl * * 1 



This frsaeuork aay aleo by useful In explaining sources ef 
variation In performance on tests, as illustrated in the figure bale*. 
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Azores* 



Factors; 

.iftluttoMl Coapstencs 
Pregeatlc Coapetence 



II. Skill Factors : 
« . Psychoohyslologl cat 

b. Foree of Representation 

c. Strategic Coapetence 




lit 



It Unouaga Uaa Situation 

h ***** of Content 

3. Distribution of Inforeetion 

4* Typa of Inforeetion 

S. Restriction* qn Longuaga 



IV. RandM Factors ! 

I. Cognitive end Affective 
Qualltiaa 

II. Intaractlona asong 
othar Factors 

111* *Msnraaart error 



Sources of Variation An Unguog* Teat Scores 
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The rslstivs contribution of trait* skill, method and random factors 
to taat performance will, of course, vary from test to tast and from 
individual to individual. Tor exemple, Bachman and Palmer (1982) 
found that a aultiple -choice taat of grammatical compstencs loadad 
auch aora haavily on tha aathod factor than did multipls-choics taata 
of aithar pragmatic or eociollngulstlc competence. Tha effect of the 
taak on tost performance has generally been dealt with 
poyrhnmotrically as systematic error variance aaaociotad uith the tast 
method (Ceapball A risks, 1959). Tha framework described hare 
■pacifies in more detail tha factors that comprise test method and 
st the same time recognizee tha relationship between the demands est 
by the task and content of tha taat and tha competencies required to 
s u cces sfully emet theme demands. 

Finally, this framework may be useful in clarifying soma 
aisconceptione regarding tha tarms "direct" and "indirect 11 ss they 
have bean applied to language taata. Tha tare) "direct test" is often 
ueed to refer to e taat method in which performance resembles "actusl" 
or "normal* language p erf or mance, while an "indirect test" is one in 
which test performance la perceived aa aoashow different from "actual" 
or "normal* pe r f or mance. Thue, writing aomploo end ore! interviewe 
era referred to ss "direct" taata* since they presumably involve the 
use of tha skills being tasted. By extension, auch taets srs of ton 
rsomrosd, virtually without question, aa construct valid end therefore 
ee legitimate criteria, for tha validation of "indirect" tests* 

There are two probleme with this, however. First, ws hsvs no 
definition of "actual" or "normal" language use that is precise enough 
f or ue to detarsdraj tha extent to which prrfaraanca a o given test is 
similar to auch language use. Indeed, the) framawork auggestsd here 
amy at beat omit ua only to dletlngulah relatively "communicative" 
from relatively "non-coomuniemtive* language performance. A more 
eerioue problem, however, ie thet the uea of the term "direct" 
confuses the behavioral nonlfoetetlon of a txmlt or competence for the 
construct itself. Aa with all aental aeaeures, languege tests era 
indirect indies tors of tha underlying treits in which ws srs 
interested, Tha fr amewo rk pr esen t ed' same captures thie distinction 
by recognizing thet there art fee tare in addition to trait factors 
thet effect performance on all language taata* whether these require 
recognition of tha correct alternative in a multiple-choice format or 
the writing of an seamy. 

3 An exeminotlon of some taata of language proficiency 

In examining proficiency testa as — a aures of communicatlvs 
parforaanca, there are two qumetione that should cs sddrssssd. 
First, to whot sxtont do tha tasks required on tu* test involvo 
communicative languege performance? Second, to whet extent does the 
test essese c ommunicative aanpetanciee? 

3.1 nUtipU-cholcc teats 

Tha eultlple-choiee taet is ana of tha tha aost widely-used 
tschniquaa for testing languege proficiency in tha world. Such taets 
typically include ornate aimed at measuring at leeet sows of ths 
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fol loving skills or coeponentot l) listsning coaprshsnsion, 2) 
structurs, and 3) resdlng coaprahension. Tha language performance 
taaka on such taata ara sleoet always rastrictad to non- reciprocal 
situstions, In which thara la no potantlal for fssd-bsck or 
nagotlatlon of aeaning. Tha arount of context gonerelly varies 
considerably froa part to part, aa doaa tha distribution and typs of 
information. Tns format of thaaa teeia oanarally restrict tha sods of 
performance to recaption. Finally, thara ara obvious raatrlctlons on 
tlas) and length. 

3.1 .1 Multiple-choice tasts of llatanlno comprehension 

Nultipls-cholcs tests of listsning coaprahsnslon typically 
includs taaka such aa 1) listening to a sentence end then identifying 
the correct per aphrsse fro* aeverel choicaa, 2) liataning to short 
dialo g u es end then finding the correct choice to a question about tha 
dialogue* and 3) liataning to a short telk end then enewering 
comprehension questions based on that talk. Tha prepositional content 
of this type of teat Is typically restricted to acedeeic topics, while 
the lllocutlonsry aete ore typlcelly Ideational and manipulative. 
In the paraphrase itse type two basic tasks ere required! 1) 
ooapr«hending e single spoken sentence (etas) and 2) recognizing the 
correct perephreae of this sentence (key) free eeong four written 
sentences. The eejorlty of the ilea a of this type require only 
grsmastleel competence for eueceeeful completion. Most depend 
prlmerlly on the knowledge of loxlcol elgnlflcetlon, or of the 
prepositional content siiprasoad by syntactic structure. Further errs, 
thaae its as can be regarded as con text -reduced, in that they ere 
generally unconnected with each other and their refarences ere to 
fistulous persons, objects, piece and actiona. In general, the teak 
of recognizing p are p hre ees is an extremely arUf iciel one and requires 
virtuslly no toemunicetive per for wanes, in that thle teak focueea 
emtluaivauy en prepositional clgnificetiun. In addition, the leek of 
coatee* rendtre thie item type highly artificial 

In the lecture, or short talk test type there ie generally e 
variety of discourse organization, Including gensrollzotlon end 
dsvslopmont, aa well ae a variety of lllocutlonery acta and 
llnguletlo foree. The basic teeke In thle teet type ere 1) 
co apsahanding a spelean discourss and 2) answering direct inforeetlon 
queetlone based on thet discourss. In thle type of teat, the extent 
of the diacourea la such wore substantial than that in the perephreae 
type. The context le olso euch aora extensive. Unfortunetely, 
however, the lectures ere frequently highly artificial, in that they 
sound :ike "read" preaonUtiona and fell to include the kinds of 
hesitations end reetateeents thet characterlie oral diacourea. There 
it lUtle ehollmnom to the teet taker to interact with the text and 
oseassjamsUy UbUm sspmrtunlty for authentic language uaa. 

3.1.2 ftUtiple-chmlce tests of structure 

The language perforaence on this type of teet Is typlcsily 
restricted entirely to eingle sentences, and thus has little potential 
for involving sttsoouree. There is generally a variety of prepositional 
oqptant, e*U* the illecutionary foree Is typically restricted to the 
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Ideetlonel function and the for* to declarative sentences. In this 
taat type tha basic task la to recognize tha syntactic form that Mill 
corractly cor o 1st* an incomplete ats tasi ant . Tha 1 tarns In this type of 
tast ara generally context-reduced, In that they represent isolated 
propositions, although thars la Qsnsrslly aoas attempt to 
contextuallza them. Frequently, however, thle context Is totelly 
Irrelevant to tha teak posed by tha Item. Consider the following 
itea, for exemples 

Tha first oxnlthlechla appeared on tha Earth 

tha early Weeo i oi c era, eome 200 

allllon years ago, 

!A) when 
B) or 
C) and 
0) during 

This statement, If found In an authentic discourse, would presuppose 
thet the reader le familiar with tha terms "ornlthlschle* end 
'flesorolc ers". In tha test context, however, thle Informetlon Is 
Irrelevant to tha syntactic structure that requlrae the preposition 
"during*. If the taet taker ettempte to process this aantance us sn 
suthsntlc use of language and la not familiar with these terms, ths 
Item Is context-reduced and may be mora difficult than If the meanings 
of theea terae were ignored entirely. Becauea of the unnecesssrlly 
difficult contoxt, items auch ae thoae probably engage other 
competencies even though they are Intended only to msssur e gremmetlcal 

3.1.3 Multiple-choice tmete of reading comprehension 

Of the various typaa of multiple-choice teet, the reeding 
comprehenelon teet haa, In ay opinion, tha grsstsst potontiel for 
requiring communicative language parfoiaanca. This Is because It Is 
ths lsast reetricted with respect to organization of discourse, 
propoeltlonal content, lllocutionery force, end forma. There ere 
beelcelly two tasks In thle teet typei l) comprehending e written 
text end 2} providing requeeted Information based on tha content of 
that text. The quest! one ere generally of two type a: Incomplete 
statement* and direct information queatlona. Tha type of Information 
requested le uaually both literal and Inferential* Items In this taat 
typa may measure grammatical, cohesive, and lllocutionery competence. 
Strategic competence, to the extent thet thle la involved In Inference 
end drawing on relevant exttaVtaxtuel knowledge, can elao be measured, 
should this be desirable* 

In general, while multiple-choice teeta are highly reetricted In 
terme of the type of p er forman ce required, I heHeve they can be used 
effectively to measure the raceptlve skills of lietenlng an d reeding, 
end to oeeeure the full range of competenciee required In these two 
skills. 
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3.3 Ural tntarvlaua 



Tha oral lntervlaa It probably tha praalar "dlract" tast of 
eholea ta.t. In that It can raqulra authantlc language uaa. or 

STE^taE ( ZZX7 nCm ^ O*™" 11 * liBiUd toTa Iu« '/oral 
StTJ^f "f" 0 "'* «• Pw-luctlwa aodaa can ba aeeeured. aa can 
thefull rang, of conpetencla. involved In tha aVlll. TactarOng a^o 
E^*? ^" 10 " Men tM " t " t •chlavaa It. full potent™ 

S??r? r ; , <h T nd ." °° tha -"Station "ting procedure™ Tha 
SiatoT -it5!* Vl " < V»" l ii J" d th * «"<»*ta through a variety of 
rf^St-Si ^ it T^2f i ", ty " lu *»"«»««y «ta. and pAaant a variety 



i ol.lVln t ^/- r mV y ' h0, * w "' tha.candldata-a parforaanca la rated 
jolaly in tern, of graaaar, pronunciation, vocabulary, and oarhaoa 
SSL wtln « to —loata aepect. of'.ffi 

or^3S?iSTt"^ T h r lon « nd *»torlral (« nvereetlorul) 

organisation, or of aoclollngulatlc coepetewe, auch aa eooraarlata- 
naaa of regleter and naturelaeae. fcM ^ , "-" s "• ~ m " "PPWPMat*. 



^l^^L"'^ f«»fetarUtle of rating acala. that hove baan 
oavalojwd for oral lnUrwlaaa la tha daf lnltlon of tha acala polnta. 
or level*. In taraa of -pacific context, and aublact natterT^ kJmn. 

STE^Tf* ° f tVfm of r* 1 " «wSn U tit of the 

r2^i •^. L "T*!? R «"**table (iLfl) oral lntervlea (fora.rly the 
JZZ&L*?** frSI) «*1 interview). Thla acala hL been 

SS^.Tt-SS?* - ^ * U ? h ditf • r •• or flf"l»tlon. a. tha Ae.rlc.n 
p£r£}jl ?^JL F 2 I 2L L S* ,,B " (*CTFL), m 1U ■Provl.lonel 
Proficiency Guldelinee* and tha luatraliejt Oanartaent of Iuinr.fi« 

i«iS^; ut v. n \ t- ««2E5£ isasss 

£.^£-77^.* Thla typa of acala daf lnltlon nay ba qulta ueoful 

Elviram.. «/ Jr^L"?./"*" 9 ! •*"«tae«t. In U. 3. college, .nd 

Became? af^h. IttLl iJ r9- "! C *i' ■ i0rant proflr " in *-tw"«. 
oeceuee or tha affact of con tax t on eonaunlcetlve lenouene uaa 

ZSZ' h S^ d T P *°! , lr f initi ° n ' ™t °ni tha^T 5 ^n 

acalaa, but aora laportantly, thalr lnterpretetlon, to tha aoaclflc 
' -hloh th-y .r. d^lg^^^Tr.UngVon^ha^ 

dlffarant acalaa are of llttla uaa fo.- oo.par.tlua purpoaw. itoT 
rnanajabla, far exeaplo, on the folloalrg acala deflnltioneT 

Cen hondlo alth confidence bit not .1th facility 
coot aoclal altuatlona Including Introduction, and 
caaualconwaraatlona about currant avanta, aa nail 
?.TPri. "P."?.' and ■"tobiographlcal Information t 
W^^" -o* raqulraaanta, naadlng help 
In handling any coapllcatlona or dlffloulUaa. 

(Loao, 1 98011 -5) 
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Cm mrriti, dsscribs, snd sxplsin in past, 
prsssnt, and futurs tlwm. Can co — tf il oU 
what, who, whan, "hsrs, how such--«nd can a*plsin 
point* of visa in in uncosplicstsd f sshion, but 
csnnot conjscturs or cohtrwtly wpport in 
opinion. Con tslk in s gsnsrsl wsy about topics 
of currant public intarast (a.g., currant Mints, 
studsnt rulss snd ragulations), ■•11 as 
psrsonsl intarast (work, laisura tlaa activitias) 
snd csn Qlvs autobiographical inforMtion. Csn 
Mk. fsctusl cwrlsom. surf it* aiUags lifs vs. 
high school lirs. • • .Can J 0 * n * 
forcsfully snd cowsunicsM nsaos snd ^ ■ 

sltustlon with s cosplicstion (s.o. calling s 
Mchsnlc for hslp with s stsllad GST. axplsining 
suspicious-looking possesions to s custoss 
official).' 

(Mm, ) 

Hss rsstrictad raoistsx flaalblll ty thoutfw unsrs 
a spscUlist rsglstsr hss bssn sscpsilsnosd, will 
hsvs scquirad som faaturas of it. . . • Can °.iys 
dstsllad Inforaatlon about own fasUly, living 
conditions, aducstlonsl bat*o«oun6i can fsscribs 
snd oonuarsa on siiaiflsy things In his snwirorwsnt 
(s.g«, his suburb, ths wssthsr)} . . . can 
coaaunlcaU on tha apot with fallM a^»" ° r 
isswdlats SLpsxior (a** ask ousatlons stout job, 
•sks Qoaplsints stalls work sondltlon*. Has off, 
stx.), 

(IisjKfB snd bVUa. 1aUHa) 
Th . flr .f nuotstlon is fros) tha oaf inltion of iaval two on ths ILR 

SJEfi ?^««^C!TS..^«I^rd 1. fro. th. 

noblM thU ctwtM for eMpmtolUty of rating, to th.t on. 1. not 

•licit .M.ctly th. mm lMvng. function, (mi rctlnq. ^.crlblng, 
•xpl.lnlng. .xpl.lnlno. cnnj^tuxlno. opinic^. 
foctMl cMptrlMM, cMwmleattoy > m*. «nd *N«9ht.). Mi - im it 
llk.ly that*, mm contMt (mi imnk, UtowM tlM y tlvltl... 

rsr i? *u\s^ffsaf^^ 

Interpretation of mfctos. fro. wlM open M thM.. w.ry 
clo..ly ral.tM to Uxm of th.lt 4m»H*-»U 9.-P"f J 
lnterpntetlon liMnlMt HtolMbl. Mhtn quit. dW.wnt typra of 
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A nora ganerslizsbls end intarpratabla approach to scsle 
dafinition, I beliava, Is to define laval* on sepsrete scales In 
taras of the chsrsc tsristics of the various coaponents of • 
coaaunlcatlva coapeUnca. In tha Oral Intarvlaw Test of Coaaylcatl va 
Proficiency ±n Enciish (Bachaan and Pslaer, 1063} v for exampla, level 
two Is dsflnad In terms of several coaponants, such sex 

Craaaar 

Llaltad range of both aorphologlc and syntactic 
structural, taut alth aoaa evidence of systematic 
rulaai control of aoaa structures usad. but with 
aany arror typaa 

Cohaalon (part of dlacouraa coapatanca) 

Moderate cohesion, Including coordination and 
siapls subordination! soaatiass confusing 
reXetlonehlpe aaong Idaat 

Sensitivity to Baoister (part of soclolinguistic coapatanca) 

Evidence of two raol stars agj control of aithar 
f creel or lnforeal register 

(Bachaan and Palaer. 196Ji2-4) 

Intarvlaaara ara lnatructad to s Lie it topics^ lllocutlonory acts* and 
soclolinguistic raglotars appropriates to tha contaxt and to tha 
candldete'e needa errf intareats. Thus thasa factors do have an 
laportant af fact on tha coaaunlcatlva parforaanca allcltad In tha 
interview, tut ainca tha acala dtf lnltlona ara Lnoapanda nt of contaxt 
and subject mat tar, tha interviewer la not constrained to allclt a 
particular sat of dlacrata g r a a aatlcal atructures, vocabulary iteas. 
or spssch acta. This la not to els* a, however, that dafining auch 
acalaa la not problematical. Oh tha contrary, tha identification and 
ranking of lllocutlonary acta In taras of approprlatanaas and level, 
for iiaacli, Is extreeely ceaplax. isvertheleae, 1 bellvo that tola 
approach to acala daflnltlon has a graat daal of potential for 
previdi/wj a •aaaaqn yardstick" for rating any given speech aaaple In 
tans a* tha c j osyona n sa of coaaunlcatlva languega proficiency. 

3.1 Cleea teeta 

The close eentinuoa to be an anigaa. While It appeare to 
saaiiiiilaaai suite closely tha kind of pr oce ss ing involved In reading* 
and thue to Involve coaaunlcatlva perforaenca, it nevcrtheleec la 
generelly perceived by test takers as a highly artiflciel teak. 
Indeed* auch of tha research with variations In this procedure has 
been Motivated, in pert et leest, by the das ire to ovorcoae Ite lack 
of appaaranca of validity. I believe thet this perceived 
artificiality la largely a function of the randoa eolation procedure* 
which frequently reeults in Iteas that are nearly iapoeaible to 
coaplste. Perhapa tlae and conditioning will be the ultlaate solution 
to thie problea. After ail* even the aultiple-choiee teat* which ia 
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m videly accspta* by ta.t tefc.ro - tha prototypical ta.t. -as once 
percolutd ee toUlly lacking in »f«e« validity*. 

Fro. ov oHn reee.rch olth th. cloza I ee convinced th*t It can 
m f uilT ranoa of coapatanciaa Involve* In raadlng. Tha key to 
ho^r UaTln tha apaclflc -orde that ara deleted, 
■^to^Lo^ihSthTepe^ on. alahaa to ensure , «. 

^r«t^-urTd. It liTaaantlar to abandon tha random d.l.tior 
SooioW-Tor. rational on. In -hlch th. t-jt M«P« ^lacta the 
STto bToeleted according to crlUrl. ooflnod In tha .ont.nt 
apeclflcetlone of tha toot. 

4 Iapllcatlona for waaaii r aaant thaory 

Given tha rang* of languago W'*™°lJW\™*™} Jj! 
coaoetenclee aaaaurad by languaga prof lclancy taato, It *oul« .eea 
u«f ol^conaldar tha .ateTSWch auch teat, can b. -i-quataly 
■nelyr.d by currwt peycno-tric tt-or*. JST^SStu 1. thaS 
thaory. both cleeelcel trua-acora and latent-trelt eodeie, is tnet 
t«t lteee orY locally lndapandant fteoch. 19901 Lord and Novlck, 
iSa) Thil laam that ^ tha^wbabllity of an individual* ana-arlng an 
lua^o^rJT.^aon^nTof hi. or har ability 
dlfflcultyl.v.l of that -lngl. lt.a. For *"a aaao.ptlon to b. 
eetlefled/uet <*velaper. -oat -rite and arr-ng. it~e « that thjy 
ara aa lndapandant of aach ofcnar M powlbl. In taraa of tha taaks 
roo-lrad a^t^t ThU^ g^Jj^S^ 

ere^d?^^ 

pr^tlcel "an. for deter e in; ng -hatha* If raaponae aodaia fit a 
given aat of ltaa defeO 

A aacond aaaua^tion of currently a-allabla 1-tant-trait aodals la 

^t th7?-TtS^Spri« •« ni - i rrr. i r°n^: 1 ^ SA^vSt 

thay all eaeaure a alngla trait or ability '„„ 

Tort. 1980). Thi. —L-ptlcn -cald ^J^j£^*™\™\(±: 

t»M of curr.it theorUe of lam. P^f^-^ 

of recant reoeorch In lang-ga tooting. ^J?*^ p ?"* 

prof lclancy la .ultidloonelon.1 (a*., i oa^uolhur 

Bachaan and Palwr. 1961. 19921 Ounbw, , 19t2l itenli. ^ 19831 Upahur 

and Hoaburg. 1993). to -1th tha •MffpUoa* Jf^SS of 

•ttaspta by taat davalop.ro to MtUf* Mi. ••■"•?' io " 

unldl.an.lon.llty ••/ *.U r.ault In i^^LTl^t-iantial 

raatrlctaxl In th.lr for. and content, to fMt, tty qulntoooontl.l 

■dlacrata-polnt* ltave ai*t ba regarded ao aiUHaajnatnnd. 



If currant thaxir.tlc.l fra.a.ortw and wwcki ft"* 1 *? 
co.Mjnlc.Uv. langv^. pzoflolaney aa onopnolng eeyatei dj^lnct but 

expre— d in a variety .f for... it WjMlM ^i^SLXiSn. 
vould provide both a challenge end «""fP°^*^ 1 £ y ^^„?E 
to teet the aeeueptione of ourwnt eodeie and to develop nore powerful 
aodaia If neceaaary. 
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Iapllcetiono for Ust Level apoent 



These -«ld upnr to exiat o eloller challenge and opportunity 
for owSworotTf Ind aox* creetlve tort proceduree end foreata. 
£ SrtSSEEre. • wriation of the oictotion cllad tno -copy- 
toetMCrlko » Lin. 1984). involvea thi riMl preeentetion of 
■Vteriel. end hoo eonoidoroblo potertiel M oooouro of text 
pWeoin^ !t i. not unrooeontol. to expect that in 
^ooowJtot to*nology. slons *ith ite lncreeelng i«UiUUto. -ill 
pro«id«U« ooonaf or ook ' ig thle tooting technique reeelbl. for 
ler >-ecele ^noting In tho at f me yeere. 

Within tho nultiple-choice frooowork, I believe it would bo 
ueef ui to eaperiewit f urthor H lth itooo in -hie!, oooo of the 
dtataLA. * porUollyoorroct. F «™ 1 'J^ y c ^o 
Mould bo ooapletely eorroct in torae of ayntcx. ooheelon. oonamwo, 
ond^rtwpoTioioUr. »bi la tho diotroctora eight too o yntactlc olly 
^STbut^ut oohoolvo, oynkacticlly and conaaivaly wrrort. but 
notinthaiwwoprioU regletor. ond ao forth. Fran itoew aueh aa 

oapacta of ceeueinieative coapatonco. Thle typa of itoe haa boon 
exeained by Fathedy OtoO). 

S Conclusion 

In thio papar I have praaontad a freoooork for •"•■inj^ 0 
o^onLnooon lenguege taata ond tnva ottooptod to deeonetreto hoo 
?n maVuir aETprovUn oooo lneltf* U.tn the type* <rf Lrw-ga 
aerfenanoe elicited end Urn langMoga eoepeanciee Moauwd by ouch 
teeaa. At toto point I would llto to ventore eeea apiniona regarding 

^u^iSnSsas^r f^WietirSjSr. 

that not ell the trait. oTeoeSnlceti* co-patenee are aguelly 
r??ou2nt to the lenguege un ne«S. of .given Th. eblHty to 

the oblllty to perfore ideetlonel function -a* •• a**" 1 "* 
SSortWnVo. arming. Finally, it eey eell bo that ret o il to; 
iileaxit toUltioo of coenuuootive Boepetonoa on aoeauraup awron 
the Ueltetlene of any given tea ting pragma. 

« tMtm eoauiteent on the pert of language tooting reeaorchere 
end lenouaoT toot develop." to content end coneteuct validity 
rWreaUWeonetont re oxoainotlon of the objective! i of our toete 
^e^eeeeeeet-nt of toe technlouea mm eeploy for •Ucltlng 
potfonMnoe. The Imoeetlono that reeult free 
m^Vmmirr^^ U have lapiiceUone for tetfc toot daveUpa.* 
toeocy.to toot they *U1 "ouira 

joeeU ond tadralagy. and nay etlaulate to* emotion or mom 
and nee technology, 
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I risegree with thoee who feel that the most pressing need is 
for further developeeot of theoretical mods la. I bsxlmve that current 
modeU are sufficiently well-defined to permit empirical verification. 
X eleo disagree with thoea who dleparaga ever being able to 
cherecterlze ell the components of communicative competence, for such 
a position would lead tie to caaaa eaplrlcal research. Th^ highest 
priority* I believe* la for ue to et ta a p t to wove to thw paradigmatic 
stage of scientific development and begin eaplrlcal verification of a 
currant theoretlcel aodel of coaauoicetivs language proficiency. 
Furthermore* I believe that the moat efftctlva ■mans of such empirical 
verlflcetlon le through language tee ting roam eh. 



Bibliography 



American Council of Teechere of Foreign languagae (ACTFl). 1982. 
ACTFL provisions! proficiency Qul os . Unas. Hastings-on-Hudson, 
New York: 3ETFC7 

Bachmen, L. F. and A. S. Palmar. 1901. "The Construct 

Velldetlon of the FSI Oral Interview". Lai^uaom learning 31, 

1:67-60. 

- 1982. "The Conetruct Velldetlon of cowe Coeponents of 
Communicative Proficiency". TE3QL Quarterly 1ft* 4:449-65. 

- 19B3.Qral Interview teat of comanmAcm^lve oroflclancv in 
English* (PenuecrlPt). 

- 1934. "Some Comments on the Terminology of language Tea ting". In 
rivere* C. (ed). Communicative comnmtenca aooroeches to 



- Forthcoming. Beelc conceme ^ lanoumoa fat validation . 
Reeding* Rasa.: HSo^aol^amSC^ **** 

Blalystok* E. end E. Ryan. Forthcoming. H fetatognltlve Framework 
for the Development of Flret and Second Language Skills". In 
f orroat-Prooaloy* 0. t., C. E. MacKinnon and T. C. Waller, (eds). 

Aco^lc^aas"* COQnitlon . *2tf JMIH WtX S Ul DSfc My YorK: 

Ceapbell, 0. T. and 0. it. Flake. 1959. "Convergent and Discriminant 
Velldetlon by the Aul 1 1 tral t-mul tlmethod HmtrU*. Psychological 
Bulletin 56* 2:81-105. 



Ca^la, n. and Sjelrv "Theoretlcel Barnes of Communicative 
Approaches to Second language Teaching and Tasting". Applied 
llnouletl^e 1, 1:1-47. 

CarroU, B. J. 1980. lestjnr cymmunXcatlwa perforates: <m 
"tudv . Oxford: Pergam jn Press. 



ERJC 14 



-18- 



Carroll, J. 8., 1961. "Fundamental Contidarstlont in Tatting for 
EnoU* l.anguags Proficiancy of Foreign Studtnts". In Cantar for 

- 19W. ■PaycftoMtrlc ThMry and Languaga Tasting*. In Ollar, J. 

itaJ^LaX • UOjmal "tlitch. Rg H l.y, 

Ciiko, C. and J. Lin. 1884. "Tha Construction and Analysis of Short 
° f .J: an £?? Proficisncy: Classical Paychoswtrlc, Lstant- 

SktU?^ * WTOttric JESS2L Aattsk 

fcjnbsr, S. a. 1982. Construct Validity and tha Intamal Structura of 
a Foraign Languaga Tact fot Savaral Matlva Languaga Croups". 
^pya aantadat tha Hating of tha ^EZSk**M 

nmmm Assoc l at lun« Na» York. 

Faaroh. C. and C Kaapar. 1983. "Plana and Strstagiaa in F oral on 
Languag* Coaaunlcatlon". In Faarch. C. and G. Kaapar (ada!) 
St^fnl- iwt 1Tlfna1fTttT gBBHOaMajg Lang*arw 

Hf lUday, «. A. K. 1976. "Tha For- of a Functional Graajaar". In 

u5SJ#W^ 124 **** * i* 0 ^- 

"•"•^l^-J^ y*? ^ . xt - "MPon* **al« Conaiatant with 
Qbaarvad DaU?* Pavchoaatrfra , 48. 1»79-92. 



Lado 
lord 



Lotd i* wr- ^av^ > w * 



ERIC 15 



-19- 



LM.. P. 1980. Ho^l^^intSE^J^^ Washington. 
O.C.: L«ngu«o« School* CIA. 
. » 1Q7 o Cowiiunicgtivi •yjlgbui djgjgTj i JpcioUngiustic 

Tdjcatiomi hiSSrck 

Savignon. 5. J. 1993. Co^cat^ ^gggL J&K£t^ 
practlc*. Hooding. *»•».« AOflimn voiioy. 



classroom 




of tha test of 
i&jcotlonol 



(sd). 
Nsuburv 

Wlddo»son. H. G. 1978. ^tflll iTTIIiTsT - "<™ticn. Oxford: 
Oxford Uniysrsity Pr 



,g. T.sts .t Socc.lv. Ability Lsvsis • * n ^""•-iLTi 
Issuss in iioamtt llltlaa IBKifr RonlBv. «••»•• 

v HUM. 



0 

ERIC 



16 



